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Abstract It is known (see e.g. Weibull (1995)) that ESS is not robust against mul- 
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1 Introduction 

The key concept in evolutionary game theory is ESS introduced by Maynard Smith 
and Price (1973) and early developments and applications to evolutionary biology 
are reported in Maynard Smith (1982). Some of the references to modern devel- 
opments include Cressman (2003), Hofbauer and Sigmund (1998), Weibull (1995). 
ESS deals with the situation when there is only one rare mutation that can influ- 
ence the population. 

In practical scenarios, an incumbent strategy may be subjected to invasions 
by several mutations. As an example, we can consider bird nesting. During the 
season, birds search for a good location. To get the best location, they rnay need 
to compete with several others. In game theoretic terminology, this corresponds 
to the invasion of multiple mutations. Thus it is desirable to study the influence of 
multiple mutations. To the best of our knowledge, we are not aware of any studies 
which have dealt with the case of multiple mutations. 

Anirban Ghatak 

Industrial Engineering and Operations Research, Indian Institute of Technology Bombay, 
Mumbai 400076, India. 
E-mail: aghatak®iitb.ac.in 

K. S. Mallikarjuna Rao 

Industrial Engineering and Operations Research, Indian Institute of Technology Bombay, 
Mumbai 400076, India. 
E-mail: mallik.rao@iitb.ac. in 

A. J. Shaiju 

Department of Mathematics, Indian Institute of Technology Madras, Chennai 600036, India. 
E-mail: ajshaiju@iitm.ac.in 



2 



Ghatak, Rao and Shaiju 



In Weibull (1995) (and Vincent and Brown (2005)), it is noted that ESS is, in 
general, not robust against multiple mutations. One possible way to approach this 
issue may be to model this situation as a multi-player game and study the cor- 
responding ESS. While there have been works dealing with ESS and multi-player 
games (see e.g. Broom et al. (1997)), we are not aware of any on the connection of 
this theory with multiple mutations. In this work, we take alternative approach, 
where we extend the notion of ESS to take care of the multiple mutations. We 
provide some interesting consequences. Our approach leads to useful refinement of 
Nash equilibrium. 

Our article is structured as follows. After the introductory section, we introduce 
evolutionary stability against multiple mutations in Section 2. We show that evolu- 
tionary stability against multiple mutations is equivalent to evolutionary stability 
against two mutations in a special case. In Section 3, we provide an equivalent 
formulation. Using the ideas in this equivalent formulation, we show that evolu- 
tionary stability against multiple mutations is equivalent to evolutionary stability 
against two mutations. Section 4 introduces the concept of local dominance and 
discusses its connections with evolutionary stability. It also draws differences with 
strict Nash equilibrium. In Section 5, we establish the fact that evolutionarily sta- 
ble strategy against multiple mutations is necessarily a pure strategy, a property 
shared by strict Nash equilibrium. One consequence of this fact is the existence 
of uniform invasion barrier. We characterize the evolutionarily stable strategies 
against multiple mutations in 2 x 2 games. We conclude our article with some 
comments and directions for further research in Section 6. 

2 Evolutionary Stability 

We consider symmetric games with payoff function u : A x A ^ M., where A is 
probability simplex in K*^ and u is given by the affine function 

k 

u{p,q) = ^ Piqju{e\e'). 

Here = (1, 0, 0, • • • , 0), • • ■ , e'' = (0, ■ ■ ■ , 0, 1) G R'' denote the pure strategies of 
the players. We, first recall the definition of an evolutionarily stable strategy (ESS 
for short). 

Definition 2.1 A strategy p € is called ESS, if for any mutant strategy r ^ p, 
there is an invasion barrier e(r) £ (0, 1) such that 

u{p, er + (1 — e)p) > u{r, er + (1 — e)p) for all < £ < e(r). (1) 

We gather some notations that we use in due course: 

BR{p) = {q € A : u{q,p) > u{r,p) W € A}, 
A^^ = {peA : p€ BR{p)}. 

By definition, an ESS is robust against any single mutation r appearing in 
small proportions. A natural question that arises is that whether an ESS is robust 
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against multiple mutations. It is known (see e.g. Weibull (1995)) that an ESS may 
not be robust against multiple mutations. We now provide an example to illustrate 
this fact. 

Example 2.1 Consider the 2x2 symmetric game with fitness (or, payoff) matrix 
^ . The unique ESS of this game is p = {\,\). 
Consider = {\, |) and = (|, \). Now, for any < e < |, 



u{p,tr^ + tr^ + (1 - 2e)p) = -i. 



But 

w(ri, er^ + er^ + (1 — 2e)p) 



Thus p is not robust against simultaneous mutations , , whenever tliey appear 
in equal propositions. 

The above example makes it clear that the Definition 2.1 is inadequate to 
capture the robustness or evolutionary stability against multiple mutations. This 
motivates the following definition. 

Definition 2.2 Let m be a positive integer. A strategy p G /i is said to be evo- 
lutionarily stable (or robust) against 'm' mutations if, for every , • • • , r™ ^ p, 
there exists e = e{r^, ■ ■ ■ , r"*) e (0, 1) such that 

u{p, eir^ + • • • + e^r™ + (1 - ei ej)p) 



> max w(r', eir H h ejr' + (1 — ei — • • • — ej)p), 

l<i<m 



for all ei, . . . , ej € (0, e]. 



Remark 2.1 Clearly if m = 1, then the above definition coincides with the definition 
of ESS. 

Definition 2.3 If e in Definition 2.2 can be chosen independent of (r^ , r^, ■■ ■ ,r"^), 
then we refer to e as a uniform invasion harrier for p corresponding to rn mutations. 

Remark 2.2 The uniform invasion barrier e, in general, depends on m. However, we 

can choose a bound on the total fraction i.e., ei + €2 H h Cm of the m mutations 

can be taken to be independent of m. We come back to this point later. 

We now provide a surprising result albeit with a very simple proof. 

Theorem 2.1 Let m > 2 and p £ A. If the strategy p is evolutionarily stable against 
two mutations with uniform invasion barrier, then it is evolutionarily stable against m 
mutations with uniform invasion barrier. 

Proof Let p be evolutionarily stable against two mutations with uniform invasion 
barrier e. Let r^, r^, ■ ■ ■ , be m strategies different from p. 
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Let €j e (0, i = 1, 2, • • • , m. Consider 

w = eir^ + e2r^ H h emr"^ + (1 - ei - €2 €m)p 

= (ei H h €m-i)s + em?"™ + (1 - ei - €2 eTO)p, 



where 



€l 1,1 €m— 1 m— 1 

-r" H 1 ; ; r 



£1 H hCm-l £1 H + 



Obviously (ei + • • • + em-i), em < e- Now considering s and as mutations, we 
have 

u{p, w) > max{u(s, to), u{r"^ , w)}, 
since p is robust against two mutations with uniform invasion barrier e. Thus 

u{p, w) > u{r"^ ,w). 

Instead of r™, we can use any r-' , j = 1, 2, • • • , m — 1 in the above analysis which 
leads to 

u{p, w) > u{r-' ,w) 

for every j = 1, 2, • • ■ , m. Thus p is evolutionarily stable against m mutations and 
^ is uniform invasion barrier corresponding to m mutations. □ 

Remark 2.3 The theorem assumes the existence of uniform invasion barrier. This 
is, indeed, the case as we show later. 



3 An Equivalent Formulation 

In this section, we provide an equivalent formulation for the evolutionary stability 
against two mutations. 

Theorem 3.1 For p £ A, the following are equivalent: 

(a) p is robust against two mutations; 

(b) p e , and, for every q € BR{p) \ {p} and r € A, 

u{p,q) > u{q,q) and u{p,r) > u{q,r). 

Proof We start with (a) ^ (b). Assume that p is robust against two mutations. In 
particular p is an ESS. Let q € BR{p) \ {p} and r ^ A. For small enough £i, €2 > 0, 
we must have 

u{p, (1 - ei - e2)p + eiq + e2r) > u{q, (1 - ei - £2)^ + £19 + £2r-). 

Rearranging the terms, we get 

£i{w(p,g) - u{q,q)} + e2{u{p,r) - u{q,r)} + (1 - £1 - £2){w(p,p) - u{q,p)} > 0. 

Since q € BR{p), the third term is zero and hence, for small enough £1, £2 > 0, we 
have 

£1 [u{p, q) - u{q, q)] + £2 [u{p, r) - u{q, r)] > 0. 
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Since p is an ESS and q G BR(p) \ {p}, we have u{p, q) > u{q, q). Prom this and the 
above inequality, it follows that u{p,r) > u{q,r). 

We now show that (b) (a). Assume (b). Let the mutations r^,r^ appear in 
proportions ei, respectively. For i = 1, 2, let 

hi{ei, £2) := u{p, eir^ + £2^^ + (1 - £1 - £2)?) - u{ri, eir^ + £2r^ + (1 - £1 - £2)^) 

We need to show that for ei, £2 small enough, /ij(£i, £2) > for each i = 1,2. Note 

that 

/»i(£i,£2) = ei[u{p,r^) - M(ri,r^)] 

+ £2[M(p,r^) - u{r\r^)] + (1 - £1 - e2)[u{p,p) - u{r\p)]. (2) 

Fix i. If r* e BR{p), then the third term on the R.H.S. of (2) is zero. By hypothesis, 
M(r\r*) < u(p, r*) and u{r'',r^) < u(p,r^), for j ^ i. Therefore, for £i,£2 > 0, 
'ij(£i,£2) > whenever r* G BR{p). 

Now let ^ BR{p). Then u{p,p) — u{r'^,p) > 0. Hence for sufficiently small £i 
and £2, we must have /i(£i, £2) > 0. Thus p is robust against two mutations. n 

Remark 3.1 The above characterization suggests the following interpretation of 
evolutionary stability against multiple mutations: An ESS is robust against mul- 
tiple mutations if and only if it dominates all strategies that are best responses to 
it. 

A careful observation of the proof of Theorem 3.1 shows that evolutionary 
stability against 2 mutations is equivalent to evolutionary stability against any 
m mutations, m > 2. We now prove this equivalence. Note that in the previous 
section, we showed this result when there is uniform invasion barrier. 

Theorem 3.2 A strategy is evolutionarily stable against two mutations if and only if 
it is evolutionarily stable against m mutations, where m > 2. 

Pr-oof We will only show that evolutionary stability against two mutations implies 
the evolutionary stability against m mutations, the other part being trivial. 

Let p be evolutionarily stable against two mutations. Let r^,r^, • • • ,r"* be 
m mutations that appear with proportions £i,£2,-- - ,£m, respectively. For i = 
1, 2, • • • , m, let 

/»i(£i, €2, • • • , em) ■= u{p, eir^ + £2r^ H h £mr™ + (1 - £1 - £2 £m)p) 

- u{ri, £ir^ + £2r^ H h £mf + (1 - £1 - £2 em)p) 

We need to show that for £i,£2,-- - ,€m small enough, /ii(£i, £2, • • • ,£m) > for 
each i = 1, 2, ■ ■ ■ , rn. Note that 

/»»(£!, £2,-- - ,£m) = ei[u{p,r^) - u{r\r^)] + £2['u(p,r^) - w(r\r^)] 

H + £m[u(p, r™) - u{r\r'")] 

+ (1 - £1 - £2 em)[u{p,p) - u{r\p)]. (3) 

Fix i. If G BR(j)), then u{r\p) — u(p,p) = 0. From Theorem 3.1, we have 

w(r*,r*) < r*) and u(r*,r-') < u{p,r^) 
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for all j ^ i. As a result, we have /ii(ei, e2, • • • ,€m) > for ei,€2,-- - ,€m > 0, 
whenever £ BR(p). 

Now let r' BR{p). Then w(p,p) — w(r',p) > 0. Thus for sufHciently small 
ei, £2, • • • , em > 0, we must have h{ei, e2, • • • , em) > 0. And hence p is evolutionarily 

stable against m mutations. n 

Remark 3.2 As a result of the Theorem 3.2, if a strategy is evolutionarily stable 
against m > 2 mutations, we refer to it simply as evolutionarily stable against 
multiple mutations, by suppressing the number m. 



4 Local Dominance 

In evolutionary game theory, ESS is characterized by means of two notions: uni- 
form invasion barrier and local superiority. Uniform invasion barrier is already 
introduced. Local superiority of a mixed strategy p implies that u{p, q) > u{q, q) 
for every g ^ p in a neighborhood of p. The interpretation of this notion is as 
follows: p is ESS if and only if in a neighborhood of p, there can not be any other 
symmetric Nash equilibrium other than p. We now introduce the corresponding 
generalization of local superiority to the case of multiple mutations. 

Definition 4.1 (Local Dominance) A strategy p £ A is said to be locally domi- 
nant if there is a neighborhood U oip such that u(p, r) > u{s, r) and u{p, r) > u{r, r) 
for every s,r & U \ {p}. 

Remark 4-1 Note that if p is locally dominant, then we can easily show that 
'"(P:?') > u{s,r) and u{p,r) > u{r,r) 

for every s G Z\ and r € U \ {p}, where U is the neighborhood as in the definition 

of local dominance. 

We now show that evolutionary stability against multiple mutations and local 
dominance are equivalent. 

Theorem 4.1 A strategy p is evolutionarily stable against multiple mutations if and 
only if it is locally dominant. 

Proof Assume that p is locally dominant. By definition, p is an ESS. Let q € BR{p) 
and q,r ^ p. To show that p is robust against multiple mutations, it suffices to 
show that u(p,r) > u{q,r). 

Note that r'^ = er + (1 — e)p is close to p whenever e > is small enough. Since 
p is weak locally dominant, for e > small enough, we must have 

< w(p, r^) - u{q, r") = e[u{p, r) - {q, r)]. 

This implies that u{p,r) > u{q,r). 

Now assume that p is robust against multiple mutations. Let s ^ p. We first 
show that there exists a neighborhood V = V{s) of p such that 



/(r) := u{p, r) — u{s, r) > 



(4) 
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for all r eV\{p}. 
Now 

f{el) = e[u{p, e) - u{s, e)] + (1 - e)[u{p,p) - u{s,p)], 
where e| = ee' + (1 — e)p. 

If s G BR{p), then, by hypothesis, f{ei) > for every < e < 1. If s ^ BR{p), then 
clearly there exists ei{s) G (0, 1) such that /(e|) > for < e < ei(s). 
Thus /(r) > when r € L; 

L = {w G A : ui = ee* + (1 — e)p for some l<i<A:, 0<e< min ei{s)}. 

l<i<k 

This clearly implies that /(r) > for every r in the convex hull V = V{s) (which 
is also a neighborhood of p) of L. Therefore u{p, r) > u(s, r) for every s and 
r £ U := n'^^iV{e^). This implies that p is locally dominant. □ 

In the following proposition we show that the inequality in the local dominance 
is strict for all s whose support has a non-empty intersection with the support of 
P- 

Theorem 4.2 Letp be robust against multiple mutations. Then there is a neighborhood 
U such that u{p, r) > u{s, r) for allr €U and s €U such that supp(s) nsupp(p) = 0. 

Proof Let p be evolutionarily stable against multiple mutations and let 

C = {p e A : Pi = ior some i € supp(p)}. 

Clearly C is compact and p £ C. We can choose e > such that 

u(p, eir + £2S + (1 - £1 + £2)p) > u{r, eir + e^s + (1 - £i - £2)p) 

for all r,s € C and < £i , £2 < £. Hence 

£ir + £2S+(l — £1 + 62)^) > u{air + a2S + {l — ai+a2)p,eir + e2S + {l — ei + e2)p) 

for every < Q:i,a2,£i,£2 < £• If we choose U = B{p;e), then from the above we 
have 

u{p, r) > u{s, r) 

for all r, s ^ p e ?7. □ 

We now make a definition. 

Definition 4.2 (Strict Local Dominance) A strategy p £ A is said to be strictly 
locally dominant if there is a neighborhood U oi p such that u{p, r) > u{s, r) for 
every s,r €U\ {p}. 



A strict Nash equilibrium is always strictly locally dominant. We may think 
that the other way is also correct. However it is not the case as the following 
example shows. 
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Example 4-1 Consider the 2x2 symmetric game with fitness matrix 

V 

Clearly BR{e^) = A, and hence it is not a strict symmetric Nash equilibrium. But 
is an ESS, since for any q e^, 

u{q,q) = -ql<Q = u{e^,q). 

Furthermore, for q,r ^ e^, 

^) = —91^1 < = u{e^,r). 
Therefore, by Theorem 3.1, is robust against m mutations, for any m > 1. 



5 Pure Strategies and Uniform Invasion Barrier 

An ESS can be mixed. On contrary, evolutionaxily stable strategy against mul- 
tiple mutations is always pure. We now prove this fact. Note that a strict Nash 
equilibrium is also necessarily pure. 

Theorem 5.1 An evolutionarily stable strategy against multiple mutations is neces- 
sarily a pure strategy. 

Proof Let p be evolutionarily stable against multiple mutations. If possible, let p 

be not a pure strategy. Let p = (pi,p2,--- ,Pk)- Let e = e(e^,e^,--- ,6^^) be the 
invasion barrier corresponding to all the k pure mutations. Let r = Qie^ + 026^ + 
h afeC*^ + (1 — ai — a2 — • • • — ai~)p, where < ai, a2, • • • , ccfc < e. Then, we have 

fc 

^Piw(e',r) =-u(p,r) > max{w(e\r),w(e^,r),-- - ,u{e'',r)}, (5) 

i=l 

which is a contradiction. Thus p must be pure. n 

So far we have not answered the question of existence of uniform invasion 
barrier. We now answer this question. 

Theorem 5.2 If p is robust against multiple mutations, then it has uniform invasion 

barrier. 

Proof Let p be robust against multiple mutations. Then p is necessarily pure. 
Without loss of generality, let us assume that p = e''. 

Let e be the invasion barrier corresponding to the pure strategies e^, • • • , e*^"^. 
We show that is invasion barrier for any m mutations with m> k — 1. 

Let r^, r^, ■ ■ ■ , r™ be m mutations with proportions ei, £2, ■ ■ ■ , respectively. 

Choose a^, i = 1, 2, ■ • • , m, j = 1, 2, • • • ,k such that r* = aje^ + af H h e*^. 

Consder 

w = eir^ + e2r^ H + Smr™ - (1 - ei - £2 em)p 

= pie^ + p2e^ + ■■■ + PkC^ + {l-Pi-p2 Pk)p 

= Pie^ + 026^ + ■■■ + Pk-ie''-^ + {I -131-132 /9fc-i)p 
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where 

j3i = eia\ + e^oih H + <^m<J'm and i = 1, 2, • • • , m. 

If we choose ei, £2, • • • , em < ^, then from the definition of evolutionary stabihty 
we have, 

w(p, w) > u{e\w),j = 1,2, • • • ,k-l. 

Thus for any i, i = 1, 2, • • • , m, we have 

fc fe 
u{p, w) = aju{p, w) > aju{e-' jw) = u{r^ ,w). 

j=l 3 = 1 

Here we have used the above A; — 1 inequaUties together with the fact that p = e'^. 
Thus p is evolutionarily stable against m mutations with ^ as the uniform invasion 
barrier. 

Note that any invasion barrier corresponding to m mutations is also invasion 
barrier corresponing to n mutations, where n < m. This completes the proof the 

thoerem. □ 

Remark 5.1 As a consequence of the proof, we note that the bound on the total 
fraction of the m mutations ei + e2 + • • • + em can be chosen to be e, which is 
independent of m. 

A careful observation of the proof of the Theorem 5.2 gives a complete charac- 
terization of evolutionary stability against multiple mutations in 2 x 2 games. We 
omit the proof as it is essentially contained in the proof of the Theorem 5.2. 

Theorem 5.3 For two player games, a pure strategy p is evolutionarily stabile against 
multiple mutations if and only if it is ESS. 

Remark 5.2 We believe that this result is not true for games with three or more 
strategies. However, we neither have a proof nor a counter example. 

6 Conclusions 

In this article, we introduced and studied the evolutionary stability against mul- 
tiple mutations. We showed that the number of mutations ( m > 2) is invariant. 
Further the evolutionarily stable strategy against multiple mutations is necessarily 
a pure strategy. This notion coincides with ESS in the case of 2 x 2 symmetric 
games, as long as the ESS is pure. Like in the case of ESS, we do not have any 
general result on the existence. Again it is in general non-unique. In deed, strict 
Nash equilibrium, itself, can be non-unique. 

Our study also leaves several question to explore further. Firstly, note that 
classical Hawk-Dove game does not have any evolutionarily stable strategy against 
multiple mutations. We do not know if this has any implication in evolutionary 
biology as of now. 

In 2 X 2 case, an ESS is evolutionarily stable against multiple mutations if and 
only if the ESS is pure. We believe that this result is not true in general case. 
However, we do not have any counter example. 
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Whether evolutionary stabihty against muhiple mutations can be seen as a 
concept related to multiplayer games seems to be an interesting issue to be ex- 
plored. If such a connection can be drawn, we can, hopefully, apply our results in 
situations modeled as multiplayer games e.g., in bird nesting. 
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